Roles and Responsibilities

• Create efficient and scalable data pipelines using AWS services such as AWS Glue, Lambda, Step Functions, and S3.
• Extract, transform, and load (ETL) data from various sources into AWS data lakes or data warehouses.
• Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
• Design and implement data models for efficient querying and reporting.
• Ensure data quality, governance, and security best practices.

Required Qualifications/Skills

• Strong proficiency in Python for data manipulation, scripting, and ETL tasks.
• Experience with AWS services such as Glue, Lambda, S3, Redshift, and EMR.
• Familiarity with big data technologies like Hadoop, Hive, and Spark.
• Knowledge of data modeling concepts and best practices.
• Proficiency in SQL and understanding of NoSQL databases.
• Understanding of data governance principles and security practices.

Posted By